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INCLUDING A METRIC IN A DIGITAL 
WATERMARK FOR MEDIA AUTHENTICATION 

Related Application Data 

[0001] This patent application is a continuation in part of U.S. Patent Application No. 
09/951,143, filed September 10, 2001. This patent application is also a continuation in part of 
U.S. Patent Application No. 09/938,870, filed August 23, 2001, which is a continuation in part 
of U.S. Patent Application No. 09/840,016, filed April 20, 2001. The above patent applications 
are hereby incorporated by reference. 

Technical Field 

[0002] The present invention relates to steganography, data hiding, and authentication of 
media, such as printed documents, images, video and audio signals. 

Background and Summary 

[0003] Digital watermarking is a process for modifying physical or electronic media to 
embed a machine-readable code into the media. The media may be modified such that the 
embedded code is imperceptible or nearly imperceptible to the user, yet may be detected 
through an automated detection process. Most commonly, digital watermarking is applied to 
media signals such as images, audio signals, and video signals. However, it may also be 
applied to other types of media objects, including documents (e.g., through line, word or 
character shifting), software, multi-dimensional graphics models, and surface textures of 
objects. 

[0004] Digital watermarking systems typically have two primary components: an encoder 
that embeds the watermark in a host media signal, and a decoder that detects and reads the 
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embedded watermark from a signal suspected of containing a watermark (a suspect signal). 
The encoder embeds a watermark by altering the host media signal The reading component 
analyzes a suspect signal to detect whether a watermark is present. In applications where the 
watemiark encodes itiformation^ the reader extracts this infonnation from the detected 
watermark. 

[0005] Several particular watermarking techniques have been developed. The reader is 
presumed to be familiar with the Hterature in this field. Particular techniques for embedding 
and detecting imperceptible watermarks in media signals are detailed in the assignee's co- 
pending U.S. Patent Application No. 09/503,881 and U.S. Patent No. 5,862,260, which are 
hereby incorporated by reference. Examples of other watermarking techniques are described in 
U.S. Patent AppUcation No. 09/404,292, which is hereby incorporated by reference. Additional 
features of watermarks relating to security, authentication of media signals and/or fragile 
watermarks are described in U.S. Patent Application Nos. 09/731,456, 60/198,138, 09/498,223, 
09/433,104, 09/616,462, 09/625,577, 60/232,163, PCT/USOl/23336 and PCT/USOl/28523, 
which are each hereby incorporated by reference. 

[0006] The invention provides a method of authenticating a media signal and related 
software, systems and applications. The method transforms at least a portion of the media 
signal into a set of frequency coefficients in a frequency domain. For example, it applies a Fast 
Fourier Transform (FFT) or other frequency transform to blocks of a media signal, such as an 
image, audio or video signal. It adjusts a relationship between selected frequency coefficients 
to a reference value. This adjustment is selected so that an alteration to be detected, such as a 
re-sampling operation or digital to analog- analog to digital conversion, alters the relationship. 
To detect the alteration, a detector computes the relationship in a potentially corrupted version 
of the signal. It then compares the result with a threshold value to detect whether the alteration 
has occurred. 
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[0007] A further aspect of the invention is a method of authenticating a media signal. The 
method evaluates signal peaks at selected frequency coefficients of the media signal In a prior 
embedding process, the media signal has been modified to include peaks at the selected 
frequencies, such as by the technique summarized in the previous paragraph. The method 
determines, based on degradation of the signal peaks, whether the media signal has been 
altered. The frequency location of the peaks may vary from one application to the next. To 
detect, scanning and printing of watermarked images for example, the peaks are located at 
higher frequencies. 

[0008] Another aspect of the invention is a watermark decoder, which includes a detector and 
analyzer for determining alteration of a watermarked media signal. The detector correlates a 
cahbration signal with a media signal suspected of carrying a watermark to determine 
orientation parameters describing orientation of the media signal at embedding of the 
watermark. The calibration signal includes a set of peaks at selected frequency coefficients. 
The analyzer orients the media signal using the orientation parameters and evaluates whether 
examining signal peaks at selected frequency coefficients in the media signal has altered the 
media signal. 

[0009] The invention also provides a method of measuring the quaUty of service of broadcast 
media signals by analyzing digital watermarks embedded in the received broadcast signal. This 
method enables the quality of the broadcast video or audio signal to be measured without 
having the original version of the signal before broadcast transmission. Instead, the method 
analyzes the strength or quality of the embedded digital watermark to determine the quahty of 
the received broadcast signal. 

[0010] One aspect of the invention is a method of measuring quaUty of service of a broadcast 
media signal using a digital watermark embedded in the broadcast media signal. The method 
extracts a digital watermark from the broadcast media signal^ and 
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evaluates the extracted digital watermark relative to a reference digital watermark to measure 
degradation in quality of service of the broadcast media signal based on differences between 
the extracted and reference digital watermarks. 

[0011] The method is implemented using fragile watermarks embedded in the broadcast 
multimedia signal. These fragile watermarks, which are imperceptible in the broadcast signal, 
are based on digital watermarks used for authentication of media objects. 

[0012] Another aspect of the present invention involves embedding an authentication metric 
in media. The metric can be embedded as a digital watermark payload. The metric is used as a 
benchmark to gauge signal quality (or strength, type^ ratio, bit-error, relationship, etc.) or 
degradation for a digital watermark embedded in the media. The metric is extracted from 
media, compared to a calculated metric for the embedded digital watermark, and a 
determination is made whether the media is an original or a copy. In yet another aspect, to 
detect a potential alteration, a detector computes a metric for a potentially corrupted version of 
the embedded media. The detector then compares its computed metric to the embedded metric 
to detect whether an alteration has occurred. An altemation may include printing, scanning, 
digital capture, copying or editing of the media. 

[0013] Further features will become apparent with reference to the following detailed 
description and accompanying drawings. The following description details a method for 
detecting whether an image has been scanned, printed or photocopied after being processed by 
the method. It also describes altemative implementations and appUcations. 

Brief Description of the Drawings 

[0014] Fig. 1 is a flow diagram illustrating a process of embedding an authentication 
watermark in a media signal. 
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[00151 Fig- 2 is a flow diagram illustrating a process of detecting the authentication 
watermark from a potentially corrupted version of the watermarked signal. 

[0016] Fig. 3 is a functional block diagram illustrating an authentication metric generating 
process. 

[0017] Fig. 4a is a functional block diagram illustrating an authentication metric embedding 
process. 

[Q018] Fig. 4b is a functional block diagram illustrating another authentication metric 
embedding process. 

[0019] Fig. 5 is a functional block diagram illustrating a process of detecting a potentially 
corrupted version of a watermark signal based on an embedded authentication metric. 

Detailed Description 

[0020] Fig. 1 is a flow diagram illustrating a process of embedding an authentication 
watermark in an input media signal (100), and in particular, in an image. The embedder begins 
by dividing a grayscale image into NxN blocks of samples at a specified resolution (102), 
where N is a pre-defined integer. For each block, the embedder computes a frequency 
transform of the image samples in that block (104), namely, a fast Fourier transform. From tiie 
mid-frequency and mid-high frequency coefficients, the embedder selects M Fourier transform 
coeflBcients (106), where M is a pre-defined integer. The coefficient locations are fixed by a 
pre-defined pattern. For example, the locations are scattered among roughly 25 to 100 
coefficient locations in the mid to mid-high frequency range of a Fourier transform domain of a 
block of image samples where N ranges from 64 to 512 at spatial resolutions ranging from 75 
to 600 dots per inch (DPI). The locations are symmetric about vertical and horizontal axes (and 
potentially diagonal axes) to facilitate detection as explained further below. 
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[0021] For each of the M selected coefficients, x, the embedder computes a ratio of the 
magnitude of a selected coefficient relative to the magnitude of its neighbors (108). In 
particular, it is a ratio of the magnitude of the selected coefficient to the average magnitude of 
the surrounding neighbors: 

r(x) = Magnitudeofx / Average_of_Magnitude_of_Eight_Neighbors_of_x 

If r(x) < r, where r is a pre-defined reference value, the embedder increases the 
magnitude of x such that: 

r(x) = r. 

[0022] In this miplementation, the value of r is a pre-defined constant. The reference may be 
derived dynamically from the input media signal. Also, the reference may be selected from a 
table of values so as to select the value of r in the table at the minimum distance fiom r(x). The 
adjustment to the host hnage is selected so as to be imperceptible or substantially imperceptible 
to. a user in an output form of the wateimarked signal. 

[0023] Next, the embedder computes the inverse fast Fourier transform on each block to 
obtain the watermarked grayscale image (1 12). The watermarked image (1 14) may then 
undergo one or more transformations, such as digital to analog conversion, printing, scanning, 
analog to digital conversion, photocopying, etc. These transformations tend to corrupt the 
watermarked image in a predictable way. 

[0024] The watermarking process of Fig. 1 may be combmed with another watermarking 
process to embed other watermarks, either robust or fragile to t^sformations such as sampMng 
distortions, geometric distortions, scaling, rotation, cropping, etc. In particular, the process 
may be combined with an embedding process described in pending U.S. Patent Application No. 
09/503,881 orU.S. Patent No. 5,862,260 to encode a calibration signal that enables a detector 
to compensate for distortions such as scaling, rotation, translation, differential scale, shear, etc. 
In one implementation, for example, the caKbration signal comprises an array of impulse or 
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delta functions scattered in a pattern in the Fourier domain of each block of image samples. To 
embed the pattern, the embedder perceptually adapts the calibration signal to the host image 
block and adds it to that block. The impulse functions of the caUbration signal have a pre- 
defined magnitude and pseudo-random phase. To make the calibration signal less perceptible 
yet detectable, the embedder modulates the energy of the calibration signal according to the 
data hiding attributes (e.g., local contrast) of the image samples to which it is added. 
Preferably, the locations of the impulse fimctions are scattered across a range of frequencies to 
make them robust to transformations like spatial scaling, rotation, scanning, printing, and lossy 
compression. Further, they are preferably arranged to be symmetric about vertical and 
horizontal axes in the Fourier domain to facilitate detection after flipping or rotating the 
watermarked image. 

[0025] The frequency coefficient locations selected for the method illustrated in Fig. 1 may 
be mutually exclusive or overlap the coefficient locations of the calibration signal. The 
calibration signal preferably has impulse fimctions at lower frequencies to survive compression, 
scanning, printing, etc. while the pattern of coefficients employed in Fig. 1 includes 
coefficients at locations that are likely to be impacted by alterations to be detected, such as 
printing, scanning and photocopying. In the case where lliey overlap,^ the modification of the 
coefficients according to Fig. 1 is implemented so as not to interfere with the calibration signal. 
In particular, the embedder adjusts the selected coefficients as shown in Fig. 1 after the impulse 
functions of the calibration signal have been introduced, or the embedder calculates the 
watermarked signal taking into account the changes of the coefficient values due to tiie 
calibration signal and the process of Fig. 1. 

[0026] Another approach is to adjust the selected fi^uency coefficients in the method of Fig. 
1 so that those coefficients act as both a calibration signal and an authentication signal. The 
locations of the coefficients for the method of Fig. 1 and the delta fimctions of the calibration 
signal are the same. The embedder increases the magnitudes of selected mid to mid-high 
frequency coefficients relative to their neighbors to achieve the desired relationship with 
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neighboring coefficients for authentication purposes. Since this modulation includes the 
addition of a delta function to the selected coefficients, it also inherently embeds a calibration 
signal comprised of delta functions at the selected locations. To compensate for rotation and 
scale, the detector performs a Fourier Mellin transform of the suspect signal and the calibration 
signal into a log-polar space and then correlates the two signals. The location of the conrelation 
peak in log polar space provides the spatial scale and rotation parameters. These parameters 
may then be used to compensate for rotation and scale changes before performing additional 
watermark decoding operations, such as the authentication operations of Fig. 2. 

[00271 To compute translation^ the delta functions added to the selected coefficients may be 
given a known pseudorandom phase. In this case, the detector correlates the phase inforaiation 
of the calibration signal with the suspect signal after compensating for rotation and scale. The 
location of the correlation peak gives the translation offset in the horizontal and vertical 
directions. 

[0028] In addition to being integrated with other watermark signal components, the process 
of Fig. 1 may be combined with a robust watermark embedding process to carry a multi-bit 
message payload carrying metadata or a link to metadata stored in an extemal database. 
Example implementations for embedding this type of robust watermark are described in 
pending U.S. Patent Application No. 09/503,881 and U.S. Patent No. 5,862,260. 

[0029] Fig. 2 is a flow diagram illustrating a process of detecting the authentication 
watermark fi-om a potentially corrupted version of the watermarked media signal (120) from 
the process of Fig. 1. The first four steps (122) are the same as shown in the embedder. For 
each block, the detector computes the average of r(x), where x is over all M selected 
coefficients (124), 

R = Average_of_r(x) 

The detector computes the average of R over all blocks (126), 
AR = Average_of_R 
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[0030] A related approach is to use a weighted average as follows. For each block, the 
detector computes a weighted average of r(x), where x is over all M selected coefficients (124), 

R = Sum__of_(weight_for Jocation_x * r(x)). 
In this approach, the weights are fixed positive constant, independent of the image, with the 
weight sum equal to 1 . For copy detection applications, the weight for each location is adapted 
for printers and printing substrates used to produce original printed items. The weighting 
factors are determined such that, for these printers and substrates, originals will be statistically 
optimally differentiated from copies. Based on our experiments, the weights in higher 
frequency components are usually higher. However the weights in the highest frequency 
components are actually tuned lower, because some reproduction devices (like photo copy 
machines) capture the highest frequency reasonably well, and the first (original) printing 
process introduces noise to the highest frequency components in the original printed items. 

[0031] After obtaining the weighted average R for each block, the detector computes the 
average of R over all blocks (126), 
AR = Average_of_R" 

[0032] To detect whether the watermarked signal has undergone alterations, the detector 
compares the average of R with a pre-defined threshold (128). If AR >= T, where T is a pre- 
defined threshold, then the detector classifies it as original. If AR < T, then the detector 
classifies it as a copy. 

[0033] Depending on the application, the detector may indicate the result (130) to a user 
through some user interface (e.g., visual display, audio output such as text to speech synthesis, 
etc.). The detector may also indicate the result (130) to another software process or device to 
take fiirther action, such as communicating the event to a another device or database for 
logging, recording tracer data about the user or device in which the alteration is detected. 
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linking the detecting device to a network resource such as a web site at a specified URL that 
informs the user about usage rules, hcensing opportunities, etc. 

[0034] To make the process robust to geometric distortion, the detector includes a pre- 
processing phase in which it correlates a calibration signal with the potentially cormpted 
watermarked signal as described in pending U.S- Patent AppUcation No. 09/503,881 or U.S. 
Patent No. 5,862,260. Using a Fourier Mellin transform, the detector maps both the calibration 
signal and the received signal into a log polar coordinate space and correlates the signals (e.g., 
using generalized matched filters) to calculate estimates of rotation and scale. After 
compensating for rotation and scale, the detector uses the phase information of the calibration 
signal to compute translation, e.g., the origin or reference point for each block. Further 
correlation operations may be used to compute differential scale (e.g., the change in scale in the 
horizontal and vertical directions after watermarking). After compensating for geometric 
distortion, the detector executes the process of Fig. 2 to detect alteration in the selected 
fi'equency coefficients modified according to the method shown in Fig. 1 . 

[0035] While the invention is illustrated with respect to a specific implementation, it may be 
implemented in a variety of altemative ways. For example, the above example specifically 
refers to a grayscale image. This example may be adapted to other types of images including 
video and still imagery, color and monochrome images, etc. For color images, the embedding 
and detecting operations may be performed on two or more color channels, including 
luminance, chrominance or some other color channels. The embedding and detecting 
operations may be appKed to fi*equency coefficients of altemative firequency transforms, such 
as DCT and wavelet, to name a few. 

[0036] The embedding process shown in Fig. 1 may be performed on a portion of the host 
signal to create a watermark signal that is combined with the host signal. For example, in one 
possible implementation, the embedder pre-filters the host signal to yield a high pass filtered 
signal mcluding content at the mid and high firequency ranges impacted by the watemiark. The 
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embedder makes the modification to this filtered signal^ and then combines the resulting 
modified signal with the original signal. 

[0037] The embedding and detecting processes may also be integrated into compression and 
decompression operations. For example, the frequency domain transform may be executed as 
part of a compression process, such as JPEG, JPEG 2000 or MPEG, where blocks of the signal 
are transformed into a frequency domain. Once converted to the frequency domain, frequency 
coefficients may be adjusted as described above. 

[0038] The embedding and detecting operations apply to other media types, including audio 
media signals, hi addition, the frequency domdn coefficients may be selected and adjusted to 
reference values to detect other types of signal alteration, such as lossy compression, digital to 
analog and analog to digital conversion, downsamplmg and upsamphng, etc. 

Semi-fragile watermarl^s 

[0039] A related watermarking approach is to use an array of Fourier magnitude unpulse 
functions with random phase (a calibration signal, also referred to as a watermark 
synchronization or orientation signal) for semi-fragile, and copy and copy-attack resistant 
watermarks. Semi-fragile refers to a watermark that degrades in response to some types of 
degradation of the watermarked signal but not others. Li particular for document authentication 
appUcations using such a watermark, the watermark decoder can determine if the watermark 
has been scanned and printed or battered by normal usage, potentially while bemg read with a 
web camera. The copy-attack relates to the assertion that one can use noise-reduction, i.e. 
Wiener filters, to lift a watermark and, then using threshold and masking techniques, one can 
re-embed it in a new image. Interestingly, these concepts are related because they both include 
an additional scanning and printing cycle, assuming the copy attack works on printed, not only 
digital, content. This type of semi-fragile watermark can be used to determine if a 
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watermarked document has been copied, possibly using a high quaUty copier aad low quality 
reader, and as such, can stop copying and can be used to measure quality of service. 

[0040] One approach to implementing a semi-fragile watemiark is to embed extra signal 
peaks in the Fourier magnitude domain that are of varying intensity, and have the watermark 
decoder determine if the watermark has been scanned and printed by the relative power of the 
extra and origmal cahbration signal peaks. The extra peaks refer to a set of peaks used to 
implement the semifragile watermark. The original calibration signal peaks refer to the ones 
aheady included in the watermark to determine its orientation in a geometrically distorted 
version of the watermarked signal. For an example of such a calibration signal, see U.S. Patent 
No. 5,862,260 and U.S. Patent Application No. 09/503,881, which are incorporated by 
reference. Some peaks are referred to as "extra" because they are included in addition to other 
peaks that form the original set of peaks in a calibration signal. 

[0041] One advantage of including the semi-fragile watermark in the cahbration signal is that 
the robust part of the watermark, which mcludes the desired detailed information such as a 
unique ID, is the multi-bit message, whereas the fragile part, which is only used to determine 
copying, is a few bit message. The fragile watermark can be considered as a smgle bit (copied 
or not) but actually allows more information by bemg frequency specific, as described below, 
hiterestingly and potentially advantageously, the semi-fragile watermark is separate but 
inherently related to the robust watermark ~ thus they cannot be separated for successful copy 
attacks. 

[0042] Specifically, the extra calibration signal peaks should be located at fi^uencies that 
best discriminates between the printing and scanning process, normal scuffing and a web 
camera reader. These locations can be determined by analyzing the fi:equency response of 
printing, scanmng, scuffing and web cameras for frequency differaices. 
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[0043] For example, a printing-scanning process may represent high-frequencies better than a 
camera, but not low frequencies. In addition, scuffing may show low-and-high frequency 
losses. Thus, the reader will be able to determine if the watermark has been copied, involving 
an additional scanning-printing process, by the relative intensities of the extra and original 
calibration signal peaks at low and high frequencies. In this example, high-and-low frequency 
loss is acceptable, whereas only low frequency loss represents a copied watermark. 

[0044] In addition, the extra calibration signal peaks could also be dependent upon the 
content of the host signal, thus providing additional defense against the copy attack. For 
example, the host image samples could be broken in 16 equal sub-blocks, and the location of 
the extra peaks depends upon the average intensity of each quadrant to the total average 
intensity. Or, if only a section of the image is visible to the reader, each 32 by 32 sample block 
could be used in the above calculation instead of the complete image. Any "hash" of the host 
image that survives a web camera reader (referred to as a perceptual hash) could be used. To 
this end, if the watermark is moved to another picture, after it is read, it is less likely that the 
exfra calibration signal peak locations are correct, not to mention that the less intense 
calibration signal points have been removed by the additional scanning-printing process. 

[00451 Alternatively, in regards to the copy attack, the content dependent information could 
be used to slightly move the location of a few original calibration signal peaks, as opposed to 
adding extra calibration signal peaks. This means that the image content is implicitly in the 
calibration signal's jitter, and the copy attack is less likely to succeed unless the read and 
embedded images have the same perceptual hash. On the one hand, this approach may reduce 
robustness of the robust message to scaling, rotation and translation. On the other hand, no 
extra bits containing the output of the perceptual hash need to be embedded in the robust 
message. 

[0046] Based upon a different basic approach for stopping the copy attack, one could create a 
1 6-bit key from the perceptual hash described above (or similar key from any perceptual hash) 
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and use it to encrypt (using RS A or DES) or scramble (using XOR) the payload and CRC bits 
before embedding tliem with an embedding protocol, which may include convolution and/or 
repetition. This means that the reader can only correctly decrypt or descramble the payload and 
CRC bits if the perceptual hash of the read image matches that of the embedded image. Thus, 
the copy attack is less likely to be successful without requiring extra bits to be included to carry 
the output of the perceptual hash. This 1 6-bit key could use any method of feature based 
identification or vector creation, such as listed in U.S. Patent Nos. 4,677,466, 5,436,653, 
5,612,729, 5,572,246, 5,621,454, and 5,918,223, and PCX patent applications WOOl/20483 and 
WOOl/20609, which are hereby incorporated by reference. 

Broadcast monitoring and quality of service witti a watermark 

10047] When content is watermarked with a unique identifier (ID), any receiver with a 
watermark detector can monitor what content is retrieved. The content can be identified by 
name via resolving the ID in a secondary database that contains at least IDs and related names, 
potentially including content owners who should be informed that the content was distributed. 
The assignee has several patent q>plications related to this invention. See, for example, U.S. 
Patent Application Nos. 09/571,422, filed May 15, 2000, 09/563,664, filed May 2, 2000, and 
09/574,726, filed May 18, 2000, which are incorporated herein by reference. 

[0048] However, an interesting improvement is that the quality of the watermark can be 
measured and used to measure quality of service for the distributor, who most likely is a 
broadcaster who wants to know that its broadcasts are being received with high-quality. 

[0049] The quality of the watermark can be determined in many fashions including using 
sani-fragile watermarks as described in this document with the application of copy resistance 
in mind. Measuring the degradation of the watermark in the received media signal provides an 
indicator of quality of service. 
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[0050] For a packet distribution system, such as IP (Internet Protocol), a Quality of Service 
(QoS) method based upon semi-fragile watermarks is better than looking for dropped packets 
since it determines tiie effect of those packets on the video or audio. Many Internet video and 
audio players can re-create packets, and during times of slow scene changes, the quality may 
not be degraded badly. In addition, when the digital watermarks embedded in fee packet 
stream have time segmented payloads that repeat at a defined or synchronized interval in the 
video or audio, the QoS of the video or audio can be measured over time by measuring the 
quahty of the imperceptible digital watermark in the received video or audio stream. 

Measuring the Watermark Signal for Authentication and Quality of Service 

[0051] There are multiple metrics for assessing watermark strength, including the degree of 
correlation between the reference watamark signal and tiie detected watermark signal, and a 
measure of symbol errors in the raw message estimates of the watermark message payload. 
One way to measure the symbol errors is to reconstruct the raw message sequence using the 
same error correction coding process of the watermark embedder on the valid message 
extracted from the watermark. This process yields, for example, a string of 1000 binary 
symbols, which can be compared with the binary symbols estimated at the output of the spread 
spectrum demodulator. The stronger the agreement between the reconstructed and detected 
message, the sfronger the watermark signal. 

[0052] To illusfrate this method, it is usefiil to review how to embed the digital watermark 
message signal imperceptibly in the host media signal, hi the embedder, the embedded bit 
sequence is created by error correction encoding a message payload, such as BCH coding, 
turbo coding, convolutional coding. Reed Solomon, etc. This embedded bit sequence is then 
spread spectrum modulated with a carrier signal, such as a pseudorandom sequence and 
embedded into the host media signal by subtly modifying the signal (e.g., adding a binary 
antipodal watermark signal resulting from the spread spectrum modulation to spatial or 
frequency domain samples of the host media signal). 
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[0053] Now, referring to the watermark detector, an approach for measuring the strength of 
the watermark signal is as follows: 

1 . Use the message payload read from the watermark to re-create the original 
embedded bit sequence (including redundantly encoded bits from error correction coding) used 
for the watermark. 

2. Convert the original bit sequence so that a zero is represented by -1 and a one is 
represented by 1. 

3 . Multiply (element-wise) the soft-valued bit sequence used to decode the 
watermark by the sequence of step 2. In particular, the digital watermark reader produces a 
soft-valued bit sequence estimated from spread spectrum demodulating the watermark signal, 
and supplies the soft-valued sequence to the error correction decoder, such as a Viterbi decoder, 
which produces an error corrected message payload. The soft-valued sequence represents an 
estimate of the original, error correction encoded bit sequence values along with a probability 
or confidence value for each bit sequence value. The reader derives the soft value by 
aggregating (e.g., summing) the estimates from demodulated chips of the spread spectrum 
sequence used to encode that bit. 

4. Create one or more measures of watermark strength from the sequence resulting 
in the previous step. One such measure is the sum of the squares of the values in the sequence. 
Another measure is the square of the sum of the values in the sequence. Other measurements 
are possible as well For example, soft bits associated with high frequency components of the 
watermark signal may be analyzed to get a strength measure attributed to high frequency 
components. Such high frequencies are likely to be more sensitive to degradation due to 
photocopying, digital to analog and analog to digital conversion, scanning and re-printing, 
broadcast process distortion, etc. 

5. Compare the strength measures to thresholds to decide if the suspect image has 
been captured from an original or a copy of the printed object. For print object authentication, 
the threshold is derived by evaluating the difference in measured watermark strength of copied 
vs. original media objects on the subject printer platform used to create the original, and a 
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variety of copiers, scanners and printers used to create copies. For quality of service 
measurement, the measurement of watermark signal strength at a receiver provides an indicator 
of video or audio signal quality at the receiver. 

[0054] This same technique of measuring symbol errors can be applied to two or more 
different watermarks embedded at different spatial resolutions. Each of the watermarks may 
have the same or different message payloads. In the first case where the watermarks have the 
same message payloads, the message extracted from one of the watermarks may be used to 
measure bit errors in each of the other watermarks. For example, the message payload from a 
robust watermark embedded at a low spatial resolution may be used to measure the bit errors 
from a less robust watermark at a higher spatial resolution. If the watermarks carry different 
message payloads, then error coding, such as convolutional. Reed Solomon, or Turbo coding, 
and error detection bits, such as CRC bits, can be used in each message payload to ensure that 
the message is accurately decoded before re-creating the original, embedded bit sequence. 

[0055] Using two or more different watermarks enables a threshold to be set based on the 
ratio of the signal strength of the watermarks relative to each other. In particular, the signal 
strength of a first watermark at a high resolution (600-1200 dpi) is divided by the signal 
strength of a second watermark at a lower resolution (75-100 dpi). In each case, the signal 
strength is measured using a measure of symbol errors or some other measure (e.g., correlation 
measiwe). 

[0056 J If the measured strength exceeds a threshold, the detector deems the watermark signal 
to be authentic and generates an authentication signal. This signal may be a simple binary 
value indicating whether or not the object is authentic, or a more complex image signal 
indicating where bit errors were detected in the scanned image. For quaUty of service 
measurement, the ratio of signal strength provides a measure of the quality of service. 
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[0057] The watennark and host signal can be particularly tailored to detect copying by photo- 
duplication and printing/re-scanning of the printed object. Likewise, the watennark signal can 
be tailored to detect video quaUty degradation for quaUty of service measurements. This entails 
embedding the watennark at particular spatial and/or temporal frequencies/resolutions that are 
likely to generate message symbol errors when tiie object is re-printed or broadcast. This 
detection process has an additional advantage in that it enables automatic autheotication and/or 
quality of service measurement, it can be used with lower quality camera devices such as web 
cams and common image scanners, and it allows the watermark to serve the functions of 
determining authenticity as well as carrying a message payload useful for a variety of 
applications. For video quahty of service measurements, the detection process can take place 
in the same hardware used to handle the video signal (assuming the video has a digital 
representation). 

[0058] The message payload can include an identifier or index to a database that stores 
information about the object or a link to a network resource (e.g., a web page on the Internet). 
The payload may also include a covert trace identifier associated witii a particular autiientic 
item, batch of items, printer, or distributor. This enables a counterfeit object, or authentic 
object that has been printed without authority to be detected and traced to a particular source, 
such as its printer, distributor or batch numbo". 

[0059] The payload may also carry printer characteristics or printer type infomiation that 
enables the watermark reader to adapt its detection routines to printer types that generated the 
authentic object. For example, the payload may carry an identifier that specifies the type of 
print process used to create the authentic image, and more specifically, the attributes of the 
halftone screen. With this infomiation, the reader can check authenticity by determining 
whether features associated with the halftone screen exist in the printed object. Similarly, the 
reader can check for halftone screen attributes that indicate that a different halftone screen 
process has been used (e.g., a counterfeit has been created using a different halftone screen). 
One specific example is a payload that identifies tiie halftone screen type and paper type. The 
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reader extracts this payload from a robust watermark payload and then analyzes the halftone 
screen and paper attributes to see if they match the halftone type and paper type indicated in the 
watermark payload. For example, the halftone type can specify the type of unstable screen 
used to create an authentic image. If this unstable screen is not detected (e.g., by absence of a 
watermark embedded in the unstable screen), then the image is considered to be a fake. 

[0060] A related approach for analyzing halftone type is to look for halftone attributes, like 
telltale signs of stochastic halftone screens vs. ordered dither matrix type screens. Dither 
matrix screens used in low end printers tend to generate tell tale pattems, such as a pattem of 
peaks in the Fourier domain that differentiate the halftone process from a stochastic screen, 
such as an error diffusion process, which does not generate such tell-tale peaks. If the reader 
finds peaks where none were anticipated, then the image is deemed a fake. Likewise, if the 
reader finds no peaks where peaks were anticipated, then the image is also deemed a fake. 
Before performing such analysis, it is preferable to use the embedded digital watermark to re- 
align the image to its original orientation at the time of printing. Attributes due to the halftone 
screen can then be evaluated in a proper spatial frame of reference. For example, if the original 
ordered dither matrix printer created an array of peaks in the Fourier domain, then the peak 
locations can be checked more accurately after the image is realigned. 

[0061] For quality of service measurement of broadcast signals, the payload may be used to 
carry information about the type of broadcast, or type of video processing used to create the 
broadcast video. The detector can then use this information to adapt the watermark signal 
measurements for the type of broadcast or video processing environment. For example, for 
certain types of broadcasts, watermark signal measurement can be made at selected frequencies 
and/or particul^ locations within the broadcast data stream. Also, the payload can be used to 
trigger certain types of quality measurements on surrounding frames of video from which the 
payload was extracted, and/or on particular parts of the frame where the watermark has been 
specifically embedded for quality of service measurements. 
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[0062] The above methods for measuring quality of service of video and audio broadcasts 
apply to both radio frequency broadcasts as well as digital network broadcasts just to name a 
few examples^ In the case of a digital signal, the quality of the received "raw" digital signal can 
be judged by any number of Channel State Measurement techniques that have been proposed, 
In the context of multimedia transmitted digitally over a network (like the internet), there can 
be congestion and packet losses. In this case, the communication channel does not have a 
guaranteed bandwidth; it only has some statistical description of availability. For video and 
audio, the solution is to use buffers at the receiver and transmitter to even out the statistical 
fluctuations in bandwidth. Still, there may be temporary periods with frame dropouts and/or 
other distortion artifacts. In these cases, quality of service monitoring is used to determine the 
quaUty of the reception over the network. The receiver can measure quality by determining 
when frames of video or audio have been lost or delayed. In addition, digital watermarks 
embedded in the video and/or audio can be used to give a more accurate measure of the actual 
quality of the delivered video; additionally, it has the advantage that it is independent of the 
video/audio coding standard used. In the case of quality of service monitoring on networks, the 
digital watermarks are preferably embedded temporally, as well as spatially (for media signals 
with a spatial component like video). 

[0063] The digital watermark is embedded temporally by embedding it across time segments, 
such as by spreading and/or repeating the watermark signal across multiple fiximes, so that the 
watermark detector can assess the degradation of the watermark over those time frames. For 
instance, the watermark can be spread over time just as it is spread over space by spread 
spectrum modulating the watermark message with a carrier signal that spans a particular 
sequence of time frames. The message can then be repeated over blocks of these time frames. 
The watermark may also carry a time dependent payload so that time frames where the video or 
audio signal has been degraded can be identified through the payload. For example, portions of 
the stream where a watermark payload cannot be decoded indicate portions of the stream where 
the quality of service has been degraded. 
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Enhanced Security Features 

[0064] For enhanced security, various elements of a watermark's embedded data may be 
encrypted. Some or the entire watermark message, including the security data in the message, 
may be encrypted. Various keys used to encode the watermark may be encrypted as well. For 
example, a key that defines the location of a watermark signal in a host signal may be 
encrypted. A key used to decode the spread message signal (e.g., a pseudorandom number) 
may also be encrypted. 

[0065] In implementations where instances of the watermark signal are repeated in the host 
signal, a key in the message payload of one instance of a watermark signal may be used to 
decrypt a message, such as security data, in other instance of the watermark signal. Or the key 
in one watermark signal payload may be used to decrypt a payload of a second watermark 
signal. The key may be included in a message payload by appending the key to the message or 
combining it with the message using some function such as an XOR, or multiplication 
operation that combines the key with the message to create a composite message. 

[0066] Keys used to decode the watermark or its message payload may also be derived from 
the host signal itself or from another watermark in the host signal. 

[0067] Digital watermarks provide a low cost, yet secure method of embedding security data 
into a product or its packaging. The embedding process can be integrated into the process of 
printing the object or its packaging. For example, for each product, the printing process may be 
adapted to print an image embedded with the product's identifier or hashed form of it. This 
process may be integrated in the mass production of a variety of printable objects, like 
packaging, containers, labels^ product documentation, credit cards, etc. 
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Copy Detection 

[0068] The security of embedded data can be enhanced through the use of copy detection 
technology. Copy detection technology can be used to detect whether a counterfeiter has made 
a copy of the object bearing the embedded security data. For example, a counterfeiter might try 
to circumvent the authentication system by making a high quality copy of the image bearing the 
embedded security data using a scanner or copy machine, and then printing that image on a 
counterfeit product or its packaging. 

[0069] The copy detection technology may be used to embed the security data (e.g., a 
watermark that is used to detect copying and convey security data) or may be separate from the 
security data (a separate watermark or other auxihary data that is used to evince copying). One 
form of copy detection technology is a digital watermark that is altered in a predictable way 
when copied with a scanner, copy machine, or other imaging device. Such imaging devices 
apply a transfonnation to an image (e.g., an analog to digital sampling, color transformation, 
etc) that can be detected by a watermark designed to change in a predictable way to such a 
transformation. 

[0070] An example of copy detection technology is a "fragile" watermark. The watermark is 
called fragile because the strength (or other signal characteristics) of the watermark signal in a 
copy of the watermarked original object is less than the strength in the original object. To 
detect copying, the embedded data decoder attempts to detect the fragile watermark. If the 
fragile watennark is not present, or has a measured strength that falls below a threshold, then 
the decoder deems the object to be an invalid copy. There are a variety of ways to measure 
strength of a watermark signal. One way is to measure the extent of the correlation between an 
image of the suspect object and a reference fragile watermark signal. 

[0071] Rather than using a separate fragile watermark, an authentication system may detect 
copying based on attributes of the watennark used to carry the embedded data. For example, 
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the wateraiark may include a synchronization or orientation signal used to detect the presence 
of the watermark and determine its orientation. Copying of a watermarked object may be 
detected by measuring changes in the watermark orientation signal. 

[0072] Since the watermark carrying the embedded data is made to survive distortion due to 
normal scanning operations required to read the watermark from an object, a fragile watermark 
may not accurately discem copying by a counterfeiter from these normal transformations. 
However, the watermark payload may be embedded in ways that survive these normal 
operations, yet still carries information from which copying can be discerned. For example, the 
payload of the watermark may be robustly encoded to withstand transformations due to 
scanning, geometric distortion, etc.^ yet convey information from which copymg can be 
discemed. One type of copy detection payload is an identifier that is related to some other 
characteristic of the object (another machine readable code, like a bar code, magnetic stripe, 
hologram, etc.). 

[0073] While the decoding process can use the orientation signal to ahgn each block, it may 
not be able to discem the precise alignment of blocks in the scanned image relative to blocks in 
the original watermarked image. As such, the decoder may only be able to recover the relative 
location ofblocks to each other, but not their absolute location in the original image. To 
address this challenge, the variation of the watermark or its payload across the image can be 
made in a relative manner from one block to the next using a secret key that defines the 
relationship between blocks. Relative changes between neighboring blocks enable the decoder 
to extract the payload from one block using information from one or more neighboring blocks. 
The relationship between the payloads of adjacent blocks may be defined according to a 
cryptographic fimction. For example^ the payload of one block may be used as a key to 
decoding an adjacent block. 

[0074] A related enhancement is to use keys for decoding the watermark, the watermark 
payload, or digital content that are dependent on the host signal. This type of host signal 
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dependent key makes it difficult to copy the embedded security data from one object to another. 
To illustrate this enhancement, consider embedded security data in an image watermark on a 
product, packaging, or label. One form of image dependent key is a key that is derived from a 
property of the image that is insensitive to the changes due to the watermark embedding 
process and recoverable in a watermark decoding operation on the embedded product 

[0075] An example of this type of key is a number that is derived from statistical properties 
of the image that are insensitive to the watermark embedding process, like the relative power 
differences between blocks of the image. The key could be, for instance, a bmary number 
computed by comparing the power of a given block with a set of other blocks, such as those in 
a predetermined neighborhood around the given block. The comparison operations yield a one 
or zero depending on whetiier the power of the given block is greater or less than the selected 
neighbors. Each comparison operation yields a single bit in the key. The key may then be 
appended or combined with the watermark payload. 

[0076] At the time of authentication, the watermark decoding process employs a 
synchronization or orientation signal to align the image data. Then it re-computes the image 
dependent key by repeating the key derivation operation as computed in the embedding 
process. The key computed at the time of decoding may be compared with the embedded key 
to check authenticity of the embedded data. Other properties that are insensitive to the 
watermark process may be used as well. 

[0077] Another enhancement that can be used as a form of authentication and copy detection 
is to embed two or more different watermarks that have a known relationship with respect to 
each other. One such relationship is a predetermined offset in the spatial image domain, or 
some other ti^sform domain, like a Discrete Fourier Transform, Discrete Cosine Transform, 
Discrete Wavelet Transform, or some re-sampling of one of these domains, like a log, log-log, 
or log-polar re-sampling. This known relationship changes in a predictable way when the 
watermarked object is copied. Thus, during the authentication process, a watermark decoding 
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process detects the watamarks and computes tiiis relationship between the watermarks. It then 
compares the computed relationship with the known relationship to determine whether some 
imauthorized transform likely occurred, such as copying. 

[0078] One way to detect that a detect whether a printed object (e.g., a document, label, 
ticket, box) has been copied is to embed two watermark signals with different characteristics 
that change differently in response to reproduction operations such as photocopying, or digital 
scanning and re-printing. To differentiate a copy from an original, the watermark decoder 
measures the characteristics of both watermarks in a digital image scan of the printed object, 
and detects a copy by the changes in the watermarks attributable to reproduction operations. 
Examples of this approach are described in U.S. Patent Application No. 09/433,104, entitled 
Methods and Systems Using Multiple Watermarks, by Geoff Rhoads and Ammon Gustafson, 
which is hereby incorporated by reference. Four approaches are listed in this document, 
including: 

1. high and low spatial resolution watermarks; 

2. one watermark with a geometrically linear assignment of pixels and another with a 
random assignment of pixels; 

3. low and high power watermarks; and 

4. one watermark with a standard RGB to HSI - HSI to RGB transform and a second 
watermark that is biased before being transformed from HSI to RGB. 

[0079] In the first case, the high-resolution watermark is degraded more than the low- 
resolution watermark. The watermark detector detects copying by measuring the change in the 
power ratio between the two watermarks in a suspect image relative to the original ratio, which 
is set at embedding and provided to the detector. In the ofker cases, the detector detects 
copying by observing changes in the relative strengths of the detected watennark signals with 
respect to the original relationship between the watermarks. 
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[0080] Similar techniques may be used to create a fragile watermark that evidences copying 
due to changes in the fragile watermark's strength relative to its original strength in the un- 
manipulated original printed object. Also, the fragile watermarks may be adapted to carry a 
message payload. Finally, the fragile watermarks may be spatially replicated in contiguoiis 
blocks of the image. The detector can then isolate the spatial location of blocks of the image 
where the fragile watermark or watermarks evidence tampering. 

[0081] The above sections refer to encryption and decryption operations. A variety of 
cryptographic technologies may be used to implement these operations. Some examples of 
encryption technologies include RSA, DES, IDEA (fritemational Data Encryption Algorithm), 
skipjack, discrete log systems (e.g., El Gamal Cipher), elliptic curve systems, cellular automata, 
etc. 

[0082] The above sections also refer to hash operations and in some cases, cryptographic 
hashes. Cryptographic hashes are fimctions used to convert a first number into a relatively 
unique second number in a manner that makes it difficult to derive the first number from the 
second number. Examples of hashing fimctions include MD5, MD2, SHA, and SHAl. 

Including an Authentication Metric in a Watermark Signal 

[0083] As discussed above a fragile (or semi-fragile) watermark is designed to degrade or 
alter when copied. An authentication metric is included in a digital watermark signal to help 
measure or gauge such degradation. In this sense an authentication metric provides a 
benchmark. An authentication metric is preferably a measure or characteristic of an original 
digital watermark signal. To detect a potential alteration, a digital watermark detector 
computes a metric for a potentially corrupted version of the digital watermark signal. The 
detector then compares its computed metric to the embedded metric to detect whether an 
alteration has occurred. An alternation may include printing, scanning, copying or editing of 
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the digital watermark signal. An alteration typically occurs when the host media signal is 
similarly altered. 

[0084] Examples of suitable authentication metrics include watermark signal strength, a 
watermark correlation value, a ratio of values, a power ratio between two watermarks, power or 
energy of a watermark component, a Fourier magnitude peak value, a peak location in a Fourier 
domain, or location for a watermark component, orientation or synchronization signal strength, 
Fourier characteristics of the orientation signal, signal gain, a threshold level, signal distortion 
level, bit-error relationship, e.g., for a watermark message, watermark signal corruption level 
and a signal to noise ratio. A metric can also include information regarding the type of 
rendering device (e.g., which type of printer printed the media from which a metric is 
generated) or an acceptable tolerance value or range for various detecting devices (e.g., digital 
cameras, optical sensors, etc.). Or the metric may include a color space description used by a 
rendering device. For instance, if a printer prints spot colors it could describe the spot colors 
used, perhaps using Pantone numbers or the like. Of course other degradation or copy 
detection measures disclosed in this document and in the incorporated by reference patent 
documents can also be used as suitable metrics. Moreova-, any digital watermark characteristic 
that can be used to determine a copy from an original signal can be included in a digital 
watermark as an authentication metric. 

[0085] With reference to Fig. 3, a digital watermark 1 0 is embedded in a media signal 1 2 by 
watermark embedder 14. Digital watermark 10 is preferably a fragile watermark, in that it is 
altered or degrades with signal processing such as scanning, printing, editing, digital capture or 
copying. Various fragile watermarking techniques are disclosed in this and the incorporated by 
reference patent documents. Embedder 14 may optionally determine a suitable digital 
watermark based on a perceptual analysis of the media signal 12, a mask, human visual 
considerations, robustness requirements, required signal gain, etc., etc. Media signal 12 
preferably corresponds to a digital signal representing, e.g., an image, graphic, photograph, file, 
artwork, video, and audio/video signal, etc. Embedder 14 outputs a digitally watermarked 
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media signal 16. The digitally watennarked media signal 16 is preferably rendered (e.g., 
printed, streamed, or broadcast if video or audio) 17. A watermark detector 18 reads the 
watermark 10 from the rendered media signal 17. The detector 18 (or a metric module in 
communication with detector 1 8) determines an authentication metric 20 for watennark 1 0 as 
embedded in rendered media 17. 

[0086] As a modification to the Fig. 3 embodiment, Detector/Metric Module 1 8 analyzes 
watermarked media signal 16 directly, without analyzing a rendered media signal 17, to 
generate a corresponding metric 20. hi one embodiment of this modification, degradation 
caused by legitimate (e.g., future) rendering is predicted (e.g., with a statistical estimation). 
Metric 20 is adjusted to accommodate the degradation prediction. Degradations may be a 
fimction of the media signal (12 or 16) or of an anticipated rendering process. For example, a 
prediction or estimate of how tiie watermark 10 degrades, e.g., as a fimction of media signal 
12's local characteristics and/or using knowledge of the anticipated legitimate media rendering 
S3«tem (e.g., a printer, broadcaster, etc.) is included in metric 20. Or metric 20 is adjusted to 
reflect such a prediction. 

[00871 With reference to Fig. 4a, metric 20 is embedded in the watermarked media signal 16 
by embedder 14a. Metiic 20 is preferably embedded as a watermark 10 payload or as a multi- 
bit message. Alternatively, metiic 20 is embedded as a new watermark 10 component or as a 
separate digital watermark. Regardless of the embedding technique, metiic 20 is included in or 
carried by a digital watermark. This digital watermark is preferably a fragile watennark. 
(Alternatively, metric 20 is embedded in a robust watermark. In this case, media signal 16 
preferably includes a fragile watermark or fragile watermark characteristics from which metiic 
characteristics can be determined.). Embedder 14a generates a watermarked media signal 22, 
which carries metiic 20 embedded therein. Embedding metiic 20 preferably does not 
significantly alter the metric characteristics of the original digital watennark signal (e.g., the 
signal from which metiic 20 was determined). 
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[0088] As an alternative metric embedding process, and with reference to Fig. 4b, media 
signal 12 is embedded with a watermark 24 to yield a watermarked media signal 22. 
Watermark 24 combines watermark 10 and metric 20 so that a metric analysis of the unaltered 
watermarked media signal 22 (or a printed version of such) yields a metric that is comparable 
to or consistent with metric 20, 

[0089] It should be noted that embedder 14 (Fig. 3) and embedder 14a (Figs. 4a and 4b) can 
be the same embedder or can embed according to the same embedding protocol or format. 
Alternatively, in the event that metric 20 is embedded as a separate digital watermark, 
embedders 14 and 14a embed using different protocols, formats or techniques, so long as a new 
metric analysis of an unaltered watermarked media signal 22 (or a printed version of such) does 
not yield a metric that is significantly different than metric 20. 

[0090] Watermarked media signal 22 is preferably rendered (e.g., printed, streamed or 
broadcast) as watermarked media 30. Watermarked media 30 includes metric 20 embedded 
therein. (A few examples of watermarked media 30 include product tags or labels, 
identification cards and documentation, passports, Hcenses, stock or bond certificates, digital 
signals, deeds and other legal documents, company logos, paper, product packagmg, audio and 
video broadcasts, sports and other trading or game cards, advertisements, printed media, 
envelopes, letterhead and stationary, books, stickers, business cards, fabric, clothing, etc., etc. 
Of course this is not an exhaustive Ust, but rather is provided as examples of watermarked 
media 30.). 

[0091] Detector/Metric Module 32 reads and decodes the digital watermark embedded within 
media 30. (As with Detector/Metric Module 18 illustrated in Fig. 3, the detector Amotions and 
metric functions of module 32 need not be carried out by the same module or application. 
Indeed, a separate detector module and a metric module can be employed.). Detector 32 
preferably decodes metric 20. For example, if metric 20 is embedded as a payload or plural-bit 
message, detector 20 reads and decodes the payload or message. Or if metric 20 is a separate 
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component or signal, detector similarly reads and interprets metric 20. Detector/Metric module 
32 analyzes the watermark signal embedded within media 30 to determine metric 34. 
Preferably, metric 34 is generated (or calculated) based on the same (or corresponding) criteria, 
algorithm or method as is used to generated metric 20. For example, if metric module 18 
detemiines metric 20 based on Fourier characteristics of a watermark orientation signal^ then 
metric module 32 also examines the Fourier characteristics of the watermark orientation signal 
to determine metric 34. (As an altemative arrangement, a digital watermark includes a payload 
(or message) indicating how metric 20 was calculated. In this altemative, metric module 32 is 
versatile, comprising the ability to generate metric 34 according to the specified metric 20 
generation criteria. Metric generation criteria and/or metric 20 can even be encrypted for 
further security.). 

[0092] Comparator 36 compares metric 20 and metric 34 and a result 38 is ou^ut or 
determined. If metric 20 and metric 34 relate the watermarked media 30 is considered 
authentic and/or unaltered. As discussed in this and in the incorporated by reference patent 
documents, a fragile watermark degrades or is altered when process (e.g., photocopied, scanned 
and then printed^ etc.). Metric 34 provides a benchmark to gauge this degradation. 
Accordingly, watermarked media 30 is considered altered/copied if metric 34 does not relate 
with benchmark metric 20. The term '"relate" is defined broadly to encompass a case where the 
metrics coincide (or match) and a case where metric 34 fall within predetermined tolerance of 
metric 20. For example, if metric 34 is within plus/minus 1 - 25% of metric 20, then 
watermarked media 30 is considered authentic and/or unaltered. (Of course, different tolerance 
ranges can be used according to authenticity requirements.). Similarly, when metric 20 
represents a threshold value, and metric 34 falls sufficiently below the threshold, then metrics 
20 and 34 are considered not to relate. The term sufficiently in this case can again be accessed 
according to a predetermined tolerance range. 

[0093] In one embodiment, metric 20 includes printer or other rendering device infoimation. 
This information conveys the type of printer (or other device) that was used to print (or 
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broadcast) media signal 17, i.e., the signal from which metric 20 was generated. Comparator 
36 uses the device information to caUbrate its comparison process. For instance, it might be 
understood that embedded media printed by Printer Z yields a metric that is a predetermined 
percentage below a metric for the embedded media if printed by Printer Y. The comparator can 
adjust its comparison to compensate. Or when metric 20 includes color space information, e.g., 
spot color information, and comparator 36 (or metric 34) determines that media 30 contains 
only CMYK (or RGB) colors, it determines that media 30 is a reprint. Of course similar 
comparisons can be made based on other color space information. 

[0094] Hence, a digital watemiark includes a benchmark metric to identify media alterations. 
Concluding Remarks 

[0095] Having described and illustrated the principles of the technology with reference to 
specific implementations, it will be recognized that the technology can be implemented in 
many other, different, forms. To provide a comprehensive disclosure without xmduly 
lengthening the specification, apphcants incorporate by reference the patents and patent 
applications referenced above. The particular combinations of elements and features in the 
above-detailed embodiments are exemplary only; the interchanging and substitution of these 
teachings with other teachings in this and the incorporated-by-reference patents/applications are 
also expressly contemplated. 

[0096] The methods^ processes, and systems described above may be implemented in 
hardware, software or a combination of hardware and software. For ex^ple^ the embedding 
processes may be implemented in a programmable computer or a special purpose digital circuit. 
Similarly, detecting processes may be unplemented in software, firmware, hardware, or 
combinations of software, firmware and hardware. The methods and processes described 
above may be implemented in programs executed from a system's memory (a computer 
readable medium, such as an electronic, optical or magnetic storage device). 


